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I. INTRODUCTION 



Johannes Berg and Mauro Sellitto 
Abdus Salam International Centre for Theoretical Physics, 34100 Trieste, Italy 

One-flip stable configurations of an Ising-model on a random graph with fluctuating connectivity 
are examined. In order to perform the quenched average of the number of stable configurations 
' we introduce a global order-parameter function with two arguments. The analytical results are 

, compared with numerical simulations. 
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— . ' Spin-models on random graphs have a long history in the statistical mechanics of disordered systems. A random 
' graph 111 consists of N nodes where each node is linked at random to a finite number of other nodes. The resulting 
structure is locally tree- like but has loops of a length In(iV). Associating each node i with an Ising-spin variable 
Si = ±1 and each connection with a bond Jij - giving a contribution —JijSiSj to the Hamiltonian ~ defines a 
^ , spin-model on a random graph. Loops in the graph are the source of frustration of the model. 

As a model of spin glasses random-graph models are particularly attractive , since they combine the analytic acces- 
sibility within the framework of mean-field theory with the finite connectivity of short-range, finite-dimensional 
^ models. Furthermore, random-graph models occur in problems of combinatorial optimisation and theoretical com- 
I t puter science where solving e.g. a satisfiability or a matching problem is equivalent to finding the ground-state 
d of a spin-model on a graph. Considering statistical ensembles of such problems with the aim of characterizing typical 
^ problems corresponds to defining an ensemble of random graphs. Interest in random-graph models has intensified 
lately and led to solution schemes beyond replica-symmetry |p[-|ll|. 

For fully connected systems, where the local field at each site is the sum of many random terms, the central limit 
theorem ensures that the local fields are Gaussian distributed. The distribution of fields may thus be characterized - 
^ ■ at the level of replica symmetry - by two variables, the mean and the variance of this distribution. The free energy is 
thus characterized by a few order-parameters, which are determined self-consistently. Finite-connectivity models on 
random graphs are mean-field models where the local fields do not consist of many terms and consequently are not 
Gaussian distributed. The free energy is characterized by a continuous order-parameter function - the distribution 
of local fields. A key step simplifying the replica analysis of random graphs models has been the introduction of a 
' global order-parameter function |^,^. In the case of Hamiltonians containing 2-spin, 3-spin, and higher interaction 
terms, the sums emerging from averaging over the disorder may be disentangled using the order parameter function 
OO c{a) = i/Nj2i ^s_s.- This function gives the fraction of sites, whose replicated spins Sj — {sf} (a = 1 . . .n) arc in a 
I given configuration g_. 

\^ • In principle any function of the spin configuration may be written as a sum of 2-spin, 3-spin, and higher interaction 
" terms and used as an energy function. However correlations between these interactions may make the resulting 
Hamiltonian intractable. In this paper we discuss how to treat random-graph models with Hamiltonians with a 
non-trivial dependence on the local magnetic field at each site. 

The central problem in this case is to find an order-parameter function to disentangle the result of averaging terms 
of the form exp{j J2a ^f^ij^'j} over the disorder (instead of the simpler exp{i J2a ^iJij^'j}^ t^*^ variables hf emerge 
^ , from defining the local fields hf). Furthermore such an order-parameter function ought to admit a replica-symmetric 
O ■ ansatz or other schemes and an analytic continuation n ^ 0. In this paper we show that this need is answered by a 
two-argument order-parameter function c(a;, r) = l/NJ2i^2.s.-^~^ ~- Viewing the variables hf,hf as new phase-space 
variables coupled to the spins, this order parameter function may be viewed as a discrete Fourier-transform of the 
generalisation of the usual order-parameter function c{a) to c{a,h) (the local fields may be integrated out explicitly). 
5^ ' As a concrete example we calculate the quenched average in replica-symmetry of the number of metastable configu- 
5^ , rations in one of the simplest model on a random graph, the ferromagnetic 2-spin model. For this model some results 
have already been obtained, albeit restricted to the annealed approximation, both for graphs with fixed connectiv- 
ity [T2[ and fluctuating connectivity p^ . For fully-connected disordered systems, like the Sherrington-Kirkpatrick 
model, the problem of metastable states has been dealt with in the classic paper by Bray and Moore |lj] . Metastable 
configurations have each spin pointing in the direction of its local field, i.e. they are stable (or marginally stable) 
against single-spin fiips. As so-called inherent structures, such configurations play a crucial role in structural glasses 
[ p5| , p^ . In spin- models of dense granular matter they play the role of blocked configurations p"7]-p9[| . Hamiltonians 
which non-trivially depend on the local magnetisation also occur in the context of lattice-gases, e.g. where sites with 
more than a certain number of neighbouring particles are energetically penalized |^o|]. Finally, a treatment of the 



1 



dynamics of spin models on random graphs will need an order-parameter function (generating function) analogous to 
the one introduced here, since the dynamics depends explicitly on the local field at each point. 

The paper is organized as follows: First the ferromagnetic 2-spin model on a random graph is introduced. After 
discussing the annealed approximation to the problem, the calculation of the quenched average of the number of 
metastable configurations is outlined in section Particular emphasis is given to the 2-argument global order- 
parameter function. The replica-symmetric ansatz for the order-parameter function is discussed and the replica- 
symmetric result for the entropy of metastable configurations is given. These expressions are evaluated numerically 
and are compared to the results of Monte-Carlo simulations and thermodynamic integration of an auxiliary model in 
section [11 . The results of generalizing the problem to 3-spin models are given in section IV and the generalisation to 
models with frustrated interactions is discussed in section 



II. METASTABLE CONFIGURATIONS OF THE 2-SPIN FERROMAGNETIC MODEL 

In the following we consider one of the simplest spin-models on a random graph, namely the two-spin ferromagnetic 
model defined by the Hamiltonian 

H = ~^C^jS^Sj , (1) 

where the sites i — 1, . . . ,N and Si — ±1. The variable Cij — 1 with i < j denotes the presence of a bond connecting 
sites i,j and Cy = denotes its absence. Choosing Cij = 1(0) randomly with probability c/N (1 — c/N) defines an 
ensemble of random graphs, where the number of bonds connected to a site is distributed with a Poisson distribution 
of finite average c. 

The condition for a (marginally) metastable configuration is that at each site i the local field hi = Cy Sj obeys 
hiSi > 0. This definition implies that a number of neutral moves remains, as spins with zero local field may be flipped 
without a cost in energy. We choose this definition, since a quench of the system will in general leave a number of 
spins with zero local field, which are crucial to the subsequent dynamics Nevertheless the marginally stable 

states could be excluded easily by considering only configurations with non-zero local magnetic field. 



A. The annealed approximation 



It is instructive to see how the average number of blocked configurations is calculated in the annealed approximation, 
where the partition function is averaged directly over the ensemble of random graphs, before passing to the more 
complicated case of the quenched average. 

The partition function configurations Z(f3) may be written as 

^(/3) = n(E S^h,;Y,C^Js^e{h,sAexpl(3/2Y,h^s^ , (2) 

i \si = ±lhi = -oo \ j J J { i ) 

where S{x;y) — 1 ii x = y and otherwise, denotes a Kronecker-delta and Q{x) denotes a discrete Heaviside step- 
function with Q{x) = 1 if a; > and otherwise. The function Yli ©(^jSj) denotes the condition for a metastable 
configuration. However none of the subsequent steps of the calculation affect this function and it may be used to 
encode any function of hi and Si. The average over the ensemble of random graphs with connectivity c may be written 
as 

(((■))) = n / - + c/N6{a, - 1)] (.) (3) 

We use the integral representation S ^/i^; CijSj^ = J^^ dhi eKp{—ihihi + i hiCijSj} for the Kronecker-deltas, 
so the average over the disorder yields a term of the form 

n [l - c/N + c/N e^p \^ih,sj + th.s,}'^ =iim«^<» exp I ~cN/2 + c/ {2N)J2e''^'"'^'^''' \ ■ (4) 
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The sum over the site labels i and j may be disentangled by introducing — l/N^^ ^sio-e*^'^ for cr, t = ±1. Using 
these 4 order parameters, the average over the disorder may be written as 

exp I -cN/2 + c/{2N) ^ e^''-^^ | = exp | ~cN/2 + cN/2 ^ c^c^ | , (5) 

where the symmetry of the exponent in under interchange of the site labels i and j is reflected by the symmetry 
of the exponent of under exchange of a and r. 

After standard manipulations, one now easily obtains the annealed average of the free energy 

l/N\n{{Z{/3))) = extr^i [-c/2 {c+^ + 2ctc^ + cZ^) - c/2 (6) 
+ ln 



^(e'3/2,yc:/c;)'^/,(2c Jcic;) + /o(2c Jcic;) + h{2cJc+ct) + ^(e^/y4/ct)"/,(2c Jc+ct) , 



Lh=l h=l 



where Ih{x) denotes the modified Bessel- function of the first kind of order h. The extremum is over the order 
parameters cj. 



B. The quenched average 



Using the replica trick InZ = lim„^o9„Z" to represent the logarithm of the partition function, the quenched 
average over the ensemble of random graphs of the free energy of metastable configurations may be written as 



{{Z^P))) = n / - c/N)SiQ,) + c/N6{a, ~ 1)] 

n f E E M E ^^^4 1 © ('^^o I \ E f^'^ } ' 



(7) 



i.a \ s^— ±1 /i'^ — — oo 



where the sum over the site indices i is from 1 to and the sum over the replica indices goes from 1 to n, where n 
is taken to be an integer. The Kronecker-deltas defining are again represented using auxiliary integrals over the 
auxiliary variables giving 



{(Z'^m) =11 dC, [(1 - c/N)S{C,,) + c/Nd{C,, - 1)] 



n ( E E P dh1/{2^) j exp I -I hfK + * E ^^^^''^ + E '^'^ \ 11 © ' 



(8) 



so that the disorder-term dj occurs only a single time in the exponent. The average over the term containing the 
disorder thus yields 



n 

i<j 



1-C/N + c/Nexp I i hls"^ 



-cA/2 + cl{2N) Y e'^- 



(9) 



The crucial problem at this point is to find an order-parameter function suitable to decouple the sums over the sites 
in the exponent. A natural choice would be ^/N'Y^^5{h — hi)S„si where the underlined terms are used to denote 

vectors in replica space, i.e. g_ = {c"}. However ft, is a vector of continuous variables, which means that there is no 
simple replica-symmetric ansatz for this order-parameter function. Instead we generalize the order parameters used 
in the annealed approximation in section [I A and define c(a;, r) — l/A^X^i S<j s.^-^-, where r is another binary vector 



in replica space. Using this global order-parameter function of two arguments (O) becomes 



exp < -cN/2 + cN/2 ^ c{a, t)c{t, a) 



(10) 
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After some formal manipulations outlined in the appendix one obtains as the replicated partition-function 
{{Z'\m = n/ '^c(a,r)exp J -c7V/2 ^ c(a, r)c(r, a) ~ cN/2 \ 

a_.T_ I _CT,T J 



(11) 



N 



The integral over the order-parameter function may be performed in the thermodynamic limit — > oo as a saddle- 
point integral. Using the shorthand e^ for the term in square brackets in ( pi] ) we obtain the self-consistent equation 
for the order-parameter function 

oo k ^ 

c(^,z) -c-^5]|^n I T.^(PvS.) I exp<j 1/2/3 ^(r'^ + 5] p^K HI ©('^"(^"+E/'n) , (12) 

k=0 ' 1=1 



where is summed over the values ±1. The assumption that c(ct, r) is real- valued is consistent with this equation. 

To treat this equation in the limit n ^ we need to make an ansatz concerning the form of the order-parameter 
function. The simplest possible choice is the replica-symmetric (RS) ansatz, which assumes that the order-parameter 
function is invariant under the permutation of the replica-indices . This in turn implies that c{a_, r) is a function 
of ct", a°'T°', and r" only. The replica-symmetric order-parameter function may thus be written as 



cia,r)^Jd.dydzPi.,y,z) 



exp {Px a- + Py ^"r" + /3z t°} 
[2ef^v cosh {13 (x -I- z)) + 2e-Py cosh (/? {x - z))]' 

where the denominator serves to normalize / dx dy dz P{x, y, z) = ^ c{q_, t) . 

Inserting the RS-ansatz ( p^ ) into the self-consistent equation (|l^) and taking the limit n - 
the self-consistent equation for P(x, y, z) in the form of an invariant density 



(13) 

one finally obtains 



P{x,y,z) = e""" 2J TtII / '^^^ dziP{xi,yi,zi) 6 ix - — In i- 
k=o '1=1-^ \ P \.i 



6 { V In I ^^^'^ — 



/++./+- 
/-+./— 

4/3 \f+-f— 



(14) 



where far serves as a shorthand for 
Ur = f{{xi,yi,zi 



1=1 Pi [ I I I I } \ \ I J 

(15) 

Without the last term - which encodes the blocking condition - this expression would factorize in I. 

From the RS order-parameter function P(x,y,z) at a given value of (3 one may also derive the values of physical 
observables, such as the energy, 



=°"^Efc! n / dxidyidziP{xuyi,zi) 



(16) 



k=0 1=1' 

nf Ep, (-1/2^ Pi) exp {/3 El ^ipi + vwi<y + /? Si + /3/2a p^I e (^ pi) 

Y.a Vti T,p^ exp {/3 J2i xiPi + Pj^iViPi^ + PJ2iZicr + f3/2aJ2i Pi}Qicr J2i Pi) 

or the fraction of sites with a given local field h 

2N 

tk ' 



iii-^^^h:M))) ^'^'"'^y li / dxidyidziP{xuyuZi) 

i k=Q ' 1=1'' 

E<T nf Eft ('^/i;^^ ft ) exp {/3 S; + /3 E/ ^iPiCr + ^ + ^/2'7 E/ © (c^ E/ P/) 



(17) 



E.nfE, 



exp {/3 xipi + f3J2i yiPi'^ + PT,i + ^/2cr Ez P/} © (^^ Ez Pi) 
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The single pointed brackets () serve as a shorthand for the average over the metastable configurations as defined by 
the partition- function (0). 

Finally, inserting the RS-ansatz (|l^) into the partition- function ([III), the free energy of blocked configurations 
averaged over the disorder may be obtained 



2 

l((lnZ)) = = ~c/2f[ I dxidyidziP{xi,yi 

1=1-^ 



(18) 



In 



e/3(yi-H?/2) cosh {13 (xi + zi + X2 + Z2)) + c-f^^y^+y^'> cosh (/3 (xi - zi - X2 + Z2)) 
2 nLi (e'^^' cosh iP {xi + zi))+ e-f^y^ cosh (/3 {xi - zi))) 



00 k 

+e~''^-^JJ / dxidyidziP{xi,yi,zi) 



k=0 1=1 



In 



nf (2e/3!/! cosh (/3 (x; + Zi)) -f- 2e-Pvi cosh (/3 (x; - z,))) 



Details of the calculations leading to these expressions may be found in the appendix. 



C. Evaluation of the RS order- parameter function 



Since the order-parameter function P(x, z, y) depends on three variables, the solution of the self-consistent equation 
(|l|) and the evaluation of (|ll)-(|ll) pose a formidable challenge. However the form of (|lj) as an invariant density 
suggests the use of a simple population dynamics to solve the self-consistent equation and evaluate the entropy of 
metastable configurations and other physical quantities. Recently this population dynamics has been used extensively 
in |l^]. For the present problem it may be adopted as follows: We consider a large number M of triples labeled 
i — 1, . . . , AA of numbers {xi, yi, Zi} with P(x, y, z) = ^/J^J^i ^i^ ~ ^i)^iy ~ yi)^{z — Zi). The self-consistent equation 
( p^ ) may then be solved numerically according to the following scheme: 



choose an integer k at random according to the Poisson distribution with mean c. 

choose k triples at random and use them to compute / , / ^, . according to (05^ 



chose another triple i at random and set Xi 



J_ In ( I+±I±z 

4/3 /_ + /_. 



J_ i„ / /++/-- 
4/3 \^ /_+/+. 



( f++f-+ \ 

\u-f-)- 



Repeating these steps a sufhciently large number of times to ensure convergence yields an approximation for the 
order-parameter function P{x, z, y), whose quality depends on the number of triples JV used. 

In the same way the expressions (|l^)-(^8|) may be evaluated. Choosing a set of k triples at random (where k is 
sampled from the appropriate distribution) the integrands of (p^)-(p^) may be computed. Averaging the results of 
sufhciently many such steps we obtain approximations of the multiple integrals over x, y, z in these expressions. 

The results discussed in the following section were obtained with Af = 5000, 350000 iterations steps, and 50000 
steps to calculate (p^-(p^. 



D. Numerical simulation 



To check our analytical results - evaluated numerically - against the results of numerical simulations, we use a method 
based on Monte-Carlo simulation of an auxiliary model and thermodynamic integration. Denoting the number of sites 
with hi Si > as Nt we define the auxiliary Hamiltonian Ti 



(19) 



where H is the original Hamiltonian (|^) and /3 is a Lagrange multiplier fixing the energy E of the original system. By 
construction, the states accessed in the limit /3aux — > 00 of are the blocked configuration of the original Hamiltonian 
with energy E fixed by the parameter /3 (provided they exist) j2^. Numerically, blocked configurations of (|^) of a 
given energy may thus be generated by a Monte-Carlo dynamics of the auxiliary Hamiltonian (19), starting at a 
low auxiliary temperature l//3aux, and gradually increasing /3aux until the ground state is found. The auxiliary 
temperature must be changed sufficiently gradually to ensure the system always remains in equilibrium. 
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Having taken the limit /3aux — oo the Lagrange multiplier (3 is simply the inverse temperature of the blocked 
configurations. Thus the entropy of the blocked configurations may be obtained up to a constant by thermodynamic 
integration 

/ dEp = S{I3) - S{I3 = go) . (20) 

The numerical results of the following section were generated by annealing ([l9| ) on four realisations of a random 
graph with N ~ 1024 increasing /3aux from to 10 in steps 0.001 every 2000 Monte-Carlo sweeps. At the end of this 
process the energy E, the fraction of sites with zero local field, and the magnetisation were measured during the last 
250 Monte-Carlo sweeps. Furthermore we checked the independence of the results on the annealing rate. In the case 
of the entropy, the constant of integration was obtained simply by fitting the resulting curve to the analytic result. 



III. RESULTS FOR THE 2-SPIN MODEL 



In the following we describe the results of the calculations of the preceding section for the case c = 2 and compare 
them to the results of numerical simulations. In figure ^ we plot both the annealed and the quenched result for the 
entr opy of blocked configurations. The results of the quenched average evaluated according to the algorithm of section 
II C fluctuate somewhat, so the curve is not very smooth, especially at negative temperatures. Nevertheless, very 
good agreement between the results of numerical simulation according to section II D and the quenched average of 
the entropy is found. The maximum of the entropy is reached at energies around —.57, so a randomly chosen blocked 
configuration will have this energy with a probability approaching 1 in the thermodynamic limit. In the ground state 
E = —1, all spins of a cluster of connected points are aligned. Hence the entropy density of blocked configurations 
is simply the number of disconnected clusters of the graph times log(2). Using the standard results of random graph 
theory |Q] we obtain a ground state entropy of 0.1122226..., which agrees with the present result to within munerical 
precision. 




-0.6 
E 



FIG. 1. The entropy density of metastable configurations as a function of their energy density E. The quenched result is 



given by the solid line, for comparison we also give the result of the corresponding annealed calculation from section [I A 
Plus-signs denote the results of numerical simulations. At high energies (large negative temperatures) numerical problems 
with the algorithm used to solve the saddle-point equations arise. 

In figure ^ we show the fraction of sites with zero local magnetic field as a function of the energy density E, which 
increases monotonously with E. This effect arises since blocked sites with non-zero magnetic field give a negative 
contribution to the energy. In order to obtain blocked states also at high energies, the system must thus make more 
of the local fields equal to zero. This is also the reason for the decrease of the entropy at increasing energies. 
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FIG. 2. The fraction of sites g with zero local magnetic field as a function of the energy density E. Plus-signs denote 
the results of numerical simulations. 

In figure ^ we plot the absolute value of the magnetisation of blocked configurations against the energy density. There 
is a second-order phase-transition from configurations with zero magnetic field at high energies, to a ferromagnetic 
phase at low energies. Again the mechanism for this is simple: in order to form blocked configurations at low 
energies, (absolutely) large local fields are required. These are achieved most easily by giving the system a finite 
magnetisation. This simply reflects the analogous transition in the model without the blocking condition, although 
the transition occurs at a lower energy. At the transition, the RS order-parameter function changes qualitatively: in 
the high-temperature phase, its weight is concentrated s.t x — z ~ Q and it remains a non-trivial function only of 
y, i.e. P{x,y,z) = 5{x)f{y)6{z), whereas in the low-temperature phase P{x,y,z) is a non-trivial function of all its 
arguments. 




-0.6 

E 



FIG. 3. The absolute value of the magnetisation as a function of the energy density E. Plus-signs {+) denote the results of 
numerical simulations. 

In figure ^ we plot the energy versus the inverse temperature of the blocked configurations P for three connectivities 
c — 2, 2.5, 3. We note that the kink in the curve - signifying the second-order nature of the phase transition - 
becomes more pronounced at higher connectivities. At c = 3 it appears that there is a jump in the curve, which would 
signify that the transition had become first order. Furthermore, for finite running times, the algorithm solving the 
saddle-point equations shows hysteresis. However none of this is borne out by closer analysis. Near the transition, 
the three curves in figure ^ collapse onto each other when rescaled by the width SP over which the transition occurs. 
Furthermore the hysteresis in the algorithm disappears when a small magnetic field is applied. We thus conclude that 
at high connectivities, the transition remains of second order, but is characterized by a long plateau at the transition 
point. 
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FIG. 4. The energy density £ as a function of the inverse temperature /3 for the three connectivities c = 2, 2.5, 3, from top 
to bottom. 

Finally, in figure |^ the phase diagram of the transition to ferromagnetic blocked states is given. Belovif the percolation 
threshold of the graph c = 1 blocked states are typically not magnetised since the graph consists of many small 
disconnected clusters: flipping all spins of such a cluster leads from one blocked configuration to another. As a result 
Pc diverges as c = 1 is approached from above. Increasing c the critical value of (3 and of the corresponding energy 
decreases monotonously as expected. Nevertheless it is interesting that the critical energy saturates already around 
c ~ 4. 



FIG. 5. Phase-diagram of the transition to ferromagnetic blocked configurations. The critical energy density Ec is plotted 
against the average connectivity c. 



IV. GENERALISATION TO THE THREE SPIN MODEL 



The generalisation to Hamiltonians with 3-spin interactions is straightforward and we only give the results. The 
Hamiltonian is defined by 



H — ^ ' CijkSiSjSk 

i<j<k 



(21) 



where the variable Cijk — 1 with i < j < k denotes the presence of a plaquette connecting sites i,j,k and Cijk = 
denotes its absence. Choosing djk = 1(0) randomly with probability 2c/N'^ (1 — 2c/N^) again defines an ensemble 
of random graphs, where each point is connected on average to c plaquettes. Proceeding as in section (^) we obtain 
for the replicated partition function 



((Z"(/3))) =l[J cic(a,T)exp J -2cN/3 ^ c{^,tp)c{t, pa)c{p,aT) - cN/i I 



(22) 
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The self-consistent equation for c(ct, r) is 

c{a,r) = e-^ £ ^ n I 5] I c (pz, o^) c {rn,ap^ exp 1 1/3/3 ^(r'^ + ^ p?77r)a4 [] ©('^'^(r'' + Eft"'?^ )) • 

I a i ) a I 

(23) 



AT 



Using the RS ansatz ( |l^ ) and taking the limit n ^ oo one obtains the self-consistent equation for P{x, y, z) (|TJ) 



P{x, y, z) = e-= It n y '^y^ ^^''^^^ dzfP{xlyl, zl)P{ 



xf,yf,zf)S ( X - ^In 



fc=0 /=i 



4/3 '"V/-+/- 



(5 ?/ — — In 



/++/— 



4/9 V /-+/+- 



(5 z — — In 



/++/-+ 
4/3 ""V/+-/— 



where 



(24) 



far = f{{xj,yl,zl,xf,yf,zf},a,T) = n X! j I^Y^^iP^^ ^^y^P^^^^ ^ l^^^^"^^^ \ 

exp|/3^xf?7i -|-/3^yfpi?7;CT-t-/3^zfpicr-|-/3/3(T^p,?/; +/3/3(tt| 9 ^cr + ' 

These expressions take on the same form as their counterparts in the 2-spin case (p^-(p^, except that where one 
term c(ct, t) stood, there are now two — a simple consequence of going from bonds connecting 2 sites to plaquettes 
of 3 sites. For completeness we also give the free energy of metastable configurations 

3 

l((lnZ)) = -/?/(/?) - -2c/3n I dxidyidziP{xuyuZi) 

1=1 



(26) 



In 



J2a T.n exp {/3 {xia + yicrrp + zirp + X2p + y2<yTp + Z2(tt + x-^t + y^frrp + z^ipa)} 



YlLi (Se/'!" cosh {(3 [xi + zi)) + 2e-Pvi cosh {(3 [xi - zi))) 



fcill / dxj dyl dzfdxf dyf dzfP{xj,ylzl)P{xf,yf,zf) 

I — n ■ J — 1 



fc=0 1 = 1 



In 



J2crIl'iJ2pi,ni exp{/3E; {^l Pi + vl PiVi'^ + zlm<^ + xfm + yfpim<^ + zfpia + l/Sapirn)} Q {<tJ2i PiVi) 
nf (26^*^' cosh (/3 {xj + zD) + 2&-^v\ cosh (/? {x\ - z/))) (2e'32'? cosh (/3 (x\ -f zf)) -f 2e-'32'' cosh (/3 {x\ - zf)) 



These equations may be solved in the same manner as described in section [I C , albeit with more numerical effort 



V. MODELS WITH DISORDERED BONDS 



In this section we sketch how the formalism introduced in section || may be used to cover also models with disordered 
bonds. The most prominent example of this case is the two-spin model on the random graph with the signs of the 
bonds being ±1 with equal probability, the Viana-Bray model [e|; 



H 



i<j 



SiSj 



(27) 



The variables — ±1 with i < j denote the presence of a bond connecting sites i, j and Jy = denotes its absence. 
For Jij = ±1 with equal probability the average over the disorder in the partition function (0) reads 
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n 



I- c/N + c/2N 



-limjv 



I exp 1 1 ^ hls^^ + I ^ h^s'i I + cxp I ^ ^s^^ - I 



(28) 



In order to decouple the two sums over the sites i,j we may use the same order-parameter function c(a, t) — 
\/N^^5rj s.e-i'- defined previously and write for (ESh 



exp I -ciV/2 + c/(4iV)y]c(CT,r)c(r,a:) + c(g, -r)c(r, -a) 



(29) 



Eliminating the conjugate order parameter we obtain ic{g_,T) = c/2 (c(T,a;) + c{—t, —a)). The rest of the calculation 
proceeds as in the ferro-magnetic case with the order-parameter function being symmetric under the simultaneous 
inversion of a and r 

An alternative, more cumbersome route, consists in introducing a new order-parameter function c{a, r) — 
1 J2i^crs. (^^' - + . Using this complex global order-parameter of two arguments (|8|) becomes 



exp { -cN/2 + c/{AN) c(ct, t)c* (t, a) 



(30) 



The remaining calculation proceeds exactly as in the case of the ferromagnet in section the sole difference being the 
fact that P{x, y, z) becomes a complex function, and equations ( 14)-(p^ acquire complex conjugates in the appropriate 
places. The detailed treatment however would exceed the scope of this paper. 



VI. CONCLUSION 



In this paper we considered the statistical mechanics of metastable configurations of spin models on random graphs. 
As a concrete example, we calculated the quenched average over the ensemble of random graphs of connectivity c 
of the number of configurations with hiSi > OVi for the case of the ferromagnetic 2-spin model. The central tool of 
the calculation was a global order-parameter function, which unlike the standard case of Hamiltonians composed of 
spin-spin interactions of various orders, takes on the form c(ct, r) = l/N"^- (So-^.e-i -. The replica-symmetric ansatz 
for such an order-parameter function of two arguments was discussed and the saddle-point equation and the free 
energy were derived. The saddle-point equation was solved numerically using a population-dynamics algorithm. The 
results were compared in detail with numerical simulations using simulated annealing and thermodynamic integration. 
The generalisations of this approach to 3-spin models and models with bond-disorder such as the Viana-Bray model 
were also discussed. 
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APPENDIX A: 

Here we fill in the essential steps leading to the results of section ||. The order-parameter function c(ct, r) is 
introduced via integrals over delta- functions represented by integrals over the auxiliary variables c(ct, r). This step 
turns equation into 
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((^"(/3))> = n 



dc{a, T)dc{g_,T) 
2tt/N 



exp < -iN ^ c(ct, r)c(a, r) - cN/2 + cN/2 ^ c(ct, t)c(t, a) 



(Al) 



^ /" dft,/(27r)"exp J l/2/3/i.o: + i^c(CT,T)e'^-^ i ]^ 



The auxiliary v ariab les may be eliminated trivially by saddle-point integration giving ic{a,T) — cc(T,a). Inserting 
this result into (Al) gives (pi]). The self-consistent equation (12) follows directly from differentiating the exponent 
of (|ll|) with respect to c(t, a;). The integral over h turns into a delta- function again - so the sum over h may be 
performed - after the exponential term containing the order-parameter function has been expanded as a power series. 

Now we need to insert the RS-ansatz ( p^ into the self-consistent equation (|l2|). Collecting all terms carrying 
replica-indices in the kth term we have 

n ^ exp I /3 ^ L ^ + 5] pta'^ + ziY,a^ + 1/2 J] aV? ) + /3/2 | 11 + E /^H) 

I K, I \ a a a a / a ) a I 

= n 1 n E I /^E + yiP>'' + -^'^^ + l/2^>r) + /3/2av4 Qia'^ir'^ + ^ p^) j (A2) 
= exp l^ln/^a^aj 

= exp J 1/4 (E'^"+E^''^"+E^" + 'M In /i 1 + 1/4 (E " E '^"^^ " E + " ) ^^-''i-i 

+1/4 ( - E ^" - E + E + ^ ) 1^ /-1 1 + 1/4 ( - E ^" + E '^"^^ - E ^" + " ) -1 1 ' 

\aa a / \ a a a / J 



where fa-r is defined in (p. 51). In the last step the we used 



1/4 (Ea + Ea + Ea + ") for T = a = 1 

1/4 (Ea - Ea - Ea + fo^ T = -1 ^ = 1 

1/4 (- Ea ~ Ea + Ea + for T = 1 a = -1 

l/4(-Ea^"+Ea^°^"-Ea^"+") for T = a = - 1 



(A3) 



Writing is = Ea'''"' = Ea'''°'''°' ^'^'l ~ Ea ^1^^ limit n ^ may be taken. Collecting all terms in k 
and Fourier-transforming with respect to s,u,t we obtain the self-consistent equation in RS in the form ([l^). The 
calculation of ([L6h-([L8[) follow the same scheme. 



[1] B. BoUobas, Random Graphs (Academic Press, London, 1985) 

[2] L. Viana and A. J. Bray, J. Phys C 18 3037 (1985) 

[3] H. Orland, J. de Physique Lett.46, L763 (1995). 

[4] M. Mezard and G. Parisi, J. de Physique Lett.46, L775 (1995). 

[5] I. Kanter and H. Sompolinsky,P/iys. Rev. Lett.58, 164 (1987). 

[6] R. Monasson, S.Kirkpatrick, B.Selman, L.Troyansky, R. Zecchina, Nature 400, 133 (1999) 
[7] M. Weigt and A. K. Hartmann,P/i2/s. Rev. Lett. 84, 6118 (2000) 

[8] D. De Dominicis and P. Mottishaw, J. Phys. A 20, L375 (1987),P. Mottishaw, Euro. Phys. Lett.4,333 (1987) 
[9] R. Monasson, J. Phys. A 31,513 (1998) 
[10] M. Mezard and G. Parisi, Eur. Phys. J. B 20, 217 (2001). 

[11] S. Franz, M. Leone, F. Ricci-Tersenghi, and R. Zecchina, Phys. Rev. Lett. 87 (2001) 127209 

[12] D. S Dean, Euro. Phys. J. B 15, 493 (2000), D. S. Dean and A. Lefevre, Euro. Phys. J. B 21, 121 (2001) 



11 



[13] 
[14] 
[15] 
[16] 
[17] 

[18] 
[19] 

[20] 
[21] 
[22] 
[23] 



J. Berg and A. Mehta, |cond-mat/0108225 . 

A. Bray and M. Moore, J. Phys. C 13, L469 (1980). 

S. Sastry, P.G. Debenedetti, F.H. Stillinger, Nature 393, 554 (1998) 

G. Biroli and R. Monasson Europhys. Lett. 50, 155 (2000). 

A. Barrat, J. Kurchan,V. Loreto, and M. Sellitto, Phys. Rev. iett.85,5034 (2000); A. Barrat, J. Kurchan, V. Loreto and 
M. Sellitto, Phys. Rev.E 63, 051301 (2001) 

J. Berg and A. Mehta, to appear in Europhys. Lett., :ond-mat/0012416 

D. S. Dean and A. Lefe vre, Phys. Rev. L ett. 86, 5639 (2001), A. Lefevre and D. S. Dean, J. P%s.A34 L213 (2001), D. S. 



:ond-mat/010622C . 



Dean and A. Lefevre, 

G. Biroli and M. Mezard, |cond-mat/0106309 
A. Barrat and R. Zecchina, Phys. Rev. E 59 R1299 (1999). 

M. Mezard, G. Parisi, and M. Virasoro, Spin glass theory and beyond. World Scientific, Sin gapore (1987). 
For a recent application of this method see: H. Makse and J. Kurchan, :ond-mat/0107163. 



12 



